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ABSTRACT • . 

- This document, one of 12 guides that have been 
developed to facilitate* evaluation by and for local education agency 
(LEA) personnel in Illinois, covers tost and outcome analysis, a 
method of relating both monetary and nonmonetary retutns to 
investments for the purpose 'of improving program planning an^ 
decision making. Throughout this activity/ the term "benefits" 
connotes both educational performance and dollar 'outcomes. Both 
outcomes and costs are focused^ on in this activity so that costs are 

'assessed in relati'on to benefits. The guide has been designed to aiU 
the person who has responsibility for leading this particular 

-^activity. It includes three sections. The first section on r 
preliminary considerations contains a brief explanation of this 
evaluation activity and the necessary steps to prepare for the ' 
evaluation undertaking. The second section of the guic^e is a 
procedure/ task breakdown, which outlines suggested tasks for 
cdnducting the evaluation activity. The third section of this guide 
contains supporting documents, including information handouts, 
example documents, and rfef^rences. (KC) 
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This Local Leader Guide is one of twelve guides that constitute the Locally- 
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IntrbduQtion ^ 



This i^ne of twelve guides that have been developed 
to facilitate evaluation by and for local education agen- 
cy (LEA) personnel This gwide has been desigrted to 
aid the individual who has assumed responsibility for 
leading this particular activity. It includes three sec- 
tions 1) preliminary Considerations. 2) Procedure/ 
^Task Breakdown: and 3) Supporting Documents All 
parts of this document are suggested, the local staff is 
encouraged to adapt or change any procedures and in- 
struments to meet the needs of its agency 

The first section of this Local Leader Guide entJtJ^d 
"Preliminary Considerations" contains a briej explana- 
tion of this evaluation activity and the necessary steps 
to prepare fpr the evaluation undertaking. Suggestions 
• are included for holding a staff meeting to discuss this 
activity ' * ' . 

The second section of this guide rs the "Procedure/' 
' Task Breakdown " This breakdown outlines suggested 
tasks for conducting this evaluation activity The tasks 
have been followed in the field tests However, these 
tasks are flexible and should be adapted in each LEA. 

The third section of this guide contains "Supporting 
Documents " These documents include: 1) information 
handouts. 2) example documents, and 3) references 
Information^handouts contain valuable information 
which wiH assist in conducting this activity.- Example 
documenTs^re forms which can be utilized with this 
e\7aluation activity. References include bibliographies 
and sources of'information for additional assistance 
These supporting documents have been developed and 
used in other LEAs However, they can be adapted 
and revised'to fit your specific needs. The local leader 
may wish to duplicate and distribute these supporting 
documents and work on this activity. ^ 

The value of this evaluation effort is dependent, upon a 
team effort in obtaining and utilizing results. By com- 
bining these results with those of other activities of an 
evaluation system, the improvement of educational 
programs and services can-begin. 



Preliminary 
Considerations 

Cost/outcome analysjs is an essential and innportanl com- 
ponent of any evaluation systenn It' is a method of relating 
returns both monetary and nonmonetary to investments 
for the purpose of improving program planning and deci- 
sion making. Throughout this activity the term benefits 
connotes both educational performance and dollar out- 
tomes Both outcomes and costs are focused on in this 
activity so that costs are assessed m relation to benefits 
Your focus may be the qntire LEA including administrative. 
, attendance and health services, pupil transportation, and 
physical plant, or it might focus entirely on instructional 
programs, courses or lessons. 

Instructional personnel are continually involved in making 
cost/outcome decisions. However, these decisions are 
generally of an inform^ nature This activity helps you for- 
malize your cost/outcome assessment For example, the 
classroom instructor may decide that a film can replace a 
field trip when studying a specific process If the student* 
outcomes are the same, the losc^er cost of the film makes 
the choice more attractive to the instructor 

A second example is the case of high cost/low incidence - 
programs Local administrators often decide to utilize a 
cooperative education prcjgram in lieu of a laboratory pro- 
gram for instruction In both of the above-mentioned 
cases, local personnel assess costs versus outcomes to 
arrive at decisions. However, wfthout a formal evaluation, 
the cost component of such analysis may carry much 
^ more weight than the outcomes 

Cost/outcome analysis can be conducted at all educa- 
tional levels You will no doubt be interested in obtaining 
information that can assist in decisions at the course ' 
level Types of delivery systems, instructional 
methodology, audiovisual media utilization, and equipment 
purchases are examples of areas where cost and out- 
come data can be of value to the classroom instructor 
You and your staff must determine your informational 
needs 



d To decrease, the costs of a high cost/low incidence 
program. 

e To provide assistance in choosing among instruc-^ 
tional alternatives 
.2 Discuss the types.of cpst information currently 
, available in your LEA. for example, instructors' salaries, 

operational costs, school txjdget, etc. 

3 Identify measures of benefit that currently exist For ex- 
ample, consider otherJocally<jirected evaluation ac- 
tivities, exam results, etc 

4 Discuss the specific nature of cost and outcome infor- 
mation needed. 

5 Discuss the instructional level(s) of cost/outcome 
analysis reporting that is/are desirable in your agency 

6 Determine who should be involved in the data gathenng 
process for example, instructors, administrators, 
employers, advisory committee members, etc. 

7 DeterminSVhich staff members are interested in work- 
ing as team members Formulate a list of volunteers 

8 Outline the tasks't)f the activity. Stress 3 major ac- 

, tivities of /1) Identifying costs. (2) identifying outcomes 
and (3) relating costs to outcomes, 
a Task A Establish a Team to Plan and Coordinate the 
Activity 

b Task B Determine the Scope for the Cost/Outcome 
Analysis Activity 

c T^skC Develop or Select a Cost Accounting Instru- 
ment. 

d Task D Collect Cost Data. 

e Task E, Summarize Cost Data. 

f Task F identify Existing Outcome Information. 

g Task G Collect and Summarize Outcome informa- 
tion ^ 

h Task H Relate Cost Information to Outcome Infor- 
mation and Prepare a Written Report. 

1 Task I Utilize Results of the Cost/Outcome Analysis. 



One responsibility of the local leader is to conduct a 
general meeting with the staff. Instructors, administrators 
and guidance personnel should be present at this meeting. ^ - 
One very important outcome of the staff meeting shpuld 
be a commitment on the part of personnel to participate in 
th9 cost/outcome evaluation activity The local leader 
should become thoroughly familiar with the procedures 
and instruments in this guide * 



Staff Meeting 

1. Discuss the nee^ to conduct a cost/outcome analysii 
Some example purposes follow ^ v-^ ^ # 

a. To help make resource allocation decisions/ 

b. To provide accountability indices. f 

c. To determine the advisability of financing the 
development of a new program. 



PrOcfiriurp/TflQlf ^ Evaluate the form(s) Several members of the evaJua- 
I I V/^WVJUI w I ClOrV tipn team should review the cost accounting instrument 
^rASkl^rifWMn looking for elements that may have been omitted 
Ol Cr4SilVU\/Wll 4 Revise the forms as needed 
r 5 ' Duplicate the forms 



Task A. Establish a Team to Plan and Coordinate 
the Activity. 

^ 1 Be sure representatives from each area that will be af- 
fected by the assessment are included For example, 
cdpsider administrators, instructors, guidance personnel 
an& advisory committee members 
2 Consider team member selection by referring to those x 
who volunteered to participate at the staff meeting as 
well as other staff members with appropriate expertise 
It may be advantageous to have at least one individual 
who has accounting experience and can help interpret 
budget records 



Task B, Determine the Scope for the Cost/Outcome 
Analysis Activity. 

1 You might be interested in focusing your assessment 

' on a number of programs, a single program, a depart- 
ment, e^ourse, a unit of instruction or a specific 
lesson 

2 Consider available resources suqh as time, energy and 
money necessary to complete the assessment. 

3 Develop one or more key questions These key ques- 
tions should reflect the decision *making needs of the 
staff The key questions should focus all efforts of Ihe 
cost/outcome analysis An example key question is **ls 

• the simulation aspect of the Health Care Aide program 
more efficient than the traditional approach'? 

Task C, Develop or Select a Cost Accounting 
Instrument. 

1 Identify the types of costs that you wish to collect 
Table 1 contains example types or classifications of 
cost information You should choose types that will be 
appropriate to the scope of your analysis 

2 Develop or select a form for tallying cost data Example 
Document 10-1 is a sample that has been developed 
for course accounting data. The headings have been 
based on the information selected from the sample 
cost element matrix (Table 1). 

You may wish to change the column headings on Ex- 
ample Document 10-1 to include your choice of cost in- 
formation or you may wish to design your own forhns 
Several specific factors should be kept in mind when 
designing forms 

a They should be simple and easy to complete 
b Plenty of space should be provided for cost data, 
c Instruments should aim at specific personnel For ex- 
ample, instructional cost forms should contain infor- 
mation to be completed by instructional personnel If 
administrative costs are to be collected, they should 
be placed on a separate form. 



Task D. Collect Cost Data. , 

1 Distribute forms to appropriate staff 

2 Orient staff to the use of the instrumenr(Example 
Document 10-1 or Jour new instrument) 

This can be accomplished by a cover letter or 
memorandum, ^n informal meeting or clearly stated 
directions included on the form Th^specific nature of 
your LEA wil^ help you decide on procedure, 
a Ask instructors to inventory the equipment they use 

for each course ' ^ 

b Ask them to estimate the, current replacement cost 
for this equipment and enter in appropriate column 
of Example Document 10-1 
c If the same equipment is used for more than one 
course or course selection, ask instructors to note 
this fact on the form in the equipment cost column 
d Ask instructors to specify the dollar amount expend- 
ed on supplies for each of their courses or course 
sections and enter it in coluijrin 7 of Example Docu- 
ment 10-1 If they onjy know a total without section 
or course breakdowns, ask them to note this on the 
form in the supply column 
e Ask instructors to specify bbok. media and travel 
costs in the appropriate cqllumns of the fornn (Exam- 
ple Document 10-1) 
3 Have staff return forms to th^ local leader 



Task E 



Summarize Cost 
Document 10-2.) 



3ta. (CompietiB Example 



The team should summarize dill cost data on pne form for 
every course. This summary pould include information 
from instructors as well as frim existing records 

1 Forms for all instructors qi the same course should 
be grouped. 

2 Course title should be enlered in column 1 of Example 
Document 10-2. 

3 Enter course sectiOQ nurtiber and instructor's name 
for each section in columns two and three resoective- 

4 Enter total salary for eajbh instructor in column 4 
These amounts may b& obtained from existing 
records I 

5 Enter prorated salary idr each section in Column 5 
The amount can be obtained by dividing an 
individual's total salary/ (column 4) by the number of 
courses that represent a full load for your institution 

6 Insert equrpment costi for each section in column 6 
If equipment is used for only one section of one 

. course, the amount entered in column 6 of Example 
Document 10-1 Should be divided by ten and entered 
in column 6 of Example Document 10-2. However, if 
multiple sections exisjt and instructors haven't broken 
the equipment costs jinto sections, then equipment 
costs need to be div/ded by the number of sections 
taught Then this anibunt should be divided by 10 (10 

/ 




Table 1 
Cost Element Matrix 









InstitU' 
tional 


Program 


Course 
Cluster 


Course 


ADMINISTRATION 


Superintendent's Office 


Salaries 


X 










Administrative Council, 


Supplies 


X 


X 








Public Relations 


Clerical Assistance 


X 


X 








Business Administration 


Consultants 


X 










Fiscal Control 


Other, i.e.. 


X 










Administration of 


Special Contracts ^ 












Building and Grounds 


Travel 


X 










Purchasing Office 














Local Program Director ^ 














Department Chairman 












INSTRUCTION 


Instructional Staff 
Textbooks 

School Library and Audio- 


Salaries; Travel- 
Clerical 

Net Profit or Cost of 
Books, Binding, etc. 

Library Books, Periodicals 








X 
X 




visuaI'Materials 


& Newspapers, Filmstrips 
& Recordings, Films, 
Radio-TV, Materials 
Costs & Rentals, 














Other (Paper, Pens) 


X 


X' 


X 


X 




Teaching Supplies 


Cost & Freight on: 
Tests, Chalk, Paper, 
Shop Supplies, etc. 






X 


X 




Other Expenses 

) 


Cost & Freight on: 
Office & Curriculum 
Supplies, Professional 

Staff. Fees for speakers 














and Consultants 


X 


* X 


X 


X 


ATTENDANCE 


Attendance-Services 


Salaries 


X 








HEALTH SERVICES 


Health Services 


Supplies ' 

Travel 

Other 


X 
X 
X 














« 








PUPli TRAN^PORTA- 


School Financed Carriers 




X 


X 






TION SERVICES 


Contracted Services and 














Public Carriers 


ft 


X 


X 








Replacement of Vehicles 


Salaries 


X 


X 








Pupil Transportation 












insurance * 
Other E^enses for Oper- 
ation and Maintenance 




X 
X 


X 
X 




■ - 


PLANT 


Of^eration 

/ 


Salaries, Contracted 
Services for Operation 
of Plant, Hedt for BIdg., 
Utilities (Except for 




• 










BIdg.), Other 


X 


X 


X 


X 




Maintenance 


Salaries, Contracted 

Services for Maintenance 
of Plant, Replacement 
of Equipment, other 
Expenses for Maintenance 










* 




of Plant 


■ X 


X 


X 


X , 
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Table 1 (continued) 



FIXED CHARGES 


Insurance and Judgme^its 


Property Insurance 




•" 










Premiums 


X 








* 




PfTinlnv/PP Inciiranr^o 
tiii^iuycc iiidUiaiiLc 

Premiums 
Liability Insurance 
Prpmtums 


X 

Y 

A 


X 

Y 






FOODSERVICE AND 


N.A. 












STUDENT ACTIVITIES 












0 


POMMNMITY QPRX/IPPQ 

Vi/wlVIIVI«JI>l 1 1 T OCnVlwwO 


Recreation 


Salaries 


X 








1 


Custodial and Detention 

Care of Children 
Welfare Act, 

Non-Pubhc School Services 


Other Expenses: 
Travel 
Supplies 


X 
X 
X 


• 






CAPITAL OUTLAY 

I ' 

1 
1 


Sites 

> 

Buildings 


Professional Services 

(Drawings, Specification, 

etc., Purchase^Costs, 

Improvements) 
Professional Services; 

Remodeling, New 

BIdg. and BIdg. 


X 


X 








Equipment 


Addition Costs * 


X 


X ' 


X 


X 




Equipment item is movable 
or fixed unit of furniture 










9 


\ 


or furnishir^gs, instrument, 
machine, apparatus, or set 
of articles meeting follow- 

- ing conditions: 

iTRetains original shape & 
appearance with use. 

2. Nonexpendable— if dam- 
^aged or some of its parts 
are lost or worn out, it is, 

. usually more feasible to re- 
pair rather than replace it. 

3. Represents an investment 
of money which makes it 
feasible & advisable to 
capitalize item. 

4. Does not lose identity 
through incorporation 
into a different or more 






\ 

f 


V 






complex unit or substance. 


X 


,x 


X 




TRANSFER ACCOUNTS 


Outgoing 


Payments to Other Districts, 
& Out-of-State Districts 














for Tuition, Transpor- 
tation, Misc. ^ 
Payments toOther-than 




1 




• 




• 




X 






1 




PublicSchools for Tuition 










incoming 


to Private Nonsectarian 
School Tuition to Inds. 

Amounts Received from 
Other School Districts in 
& out of State for:-Tui- 

sy tion. Transportation, 


X 


X 










Miscellaneous. 


X 


X 


X 


X 
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years average life of most equipment). This prorated 
amount should be entered in column 6 of Example 
Document 2 for eachsgction. An example is showgF 
below: ^ ^ 



Total Equipment Cost 
# of Sections 



/ 10 Years = Per Section 
Equipment Cost 



. $50,000 / 10 Years = $1,000 Per Section 
5 Sections • - 

7. Per section supply costs should be entered in column 
7 of Example Document 10-2 If instructors with multi- 
ple sections had supplies broken down for each sec- 
tion, .then thggA amounts can be entered directly 
However, if instruQjors noted on their form that all 
they had was total cost, the total should be divided by 
the number of sections taught 

Total Supply Costs = per Section Supply Cost 
i \ # of Sections 

' 8 Media, travel and other costs should be entered \r\ Ex- 
" ^ ample Document 1 0-2 Prorating may be necessary 
/ 9. Alt costs for each section should be summed and 
entered in column 10 This represents total section 
costs. 

10 Total section costs for all sections of a course should 
be summed and recorded in column 1 l.of Example ^ 
Document 10-2. This amount represents the total ^ 
course cost. 

1 1 Enter the number of students enrolled in each section 
and indicate the course credit awarded for the course 
in columns 12 and 13 respectively. . 

12. Multiply the total number of students for the course by 
• the number pf credits awarded. Enter, this figure in 

column 14 of Example Document 10-2. This equals 
the total student credit hours generated.^ 

13. Divide the total course cost figure (colurrin 1 1) by the 
number of credit hours generated (column 14) and 
enter the quotient In column 15 This is the cost per 
credit hour 



Task F. Iderrtffy Existing Outcome Information. 
(Complete Example Document 10*3.) 

1 Ask each course .instructor to list outcome information 
sources that are available for their courses for a 
specified period of time, e.g., two years. (You may use 
column 1 of Example Document 10-3.) They might in- 
clude: 

a. Final examination scores 

b. Co-op supervisor ratings 

c. Course follow-up information 

d. Others 

2. In the same column Of Example Document 10-3, have" 
instructors iflentify outcome information sources fhat 
oth6r units or agencies may hav^ These might include. 

a. , Certification exam scores 

b. Program follow-up data ' ^ , 

c. Empldyer survey data 

d. Advisory committee ratings 

e. Others 

3. Then, instructors should specify the indices thaj are ^ 
avaHabfe for each outcome data source.. This informa- 
tion should be listed in column 2 'of Example Document 



103. Two example sources with corresponding indices 
are presented below: 

a. Radiology technician certification examination 

1. Average composite score 

2. Average perform^ance test score 
' 3. Average o;al •review score 

4, Average written score 
b Student foilow-up survey 
1 Average graduate salary 

2. Percent employed in related jobs 

3. Average promotion rate 

4. You might find it necessary to initiate additional LDE or 
other data gathering activities to supplement your out- 
come information. Vou might consider. 

* a Siudent/Employer Follow-up Survey, Activity #2. . ^ 
b^ Measuring Student Competencies, Activity #3. 

Task G. ciollect and Symrttarize Outcome 

Information. (ComptetQ Example E}ocument 
104.) 

1 Develop an outcome' data form or adapt the one 
presented as Example Document 10-4 

a From Example Document 10-3,' choose those indices 
of performance you wish to use. 

b. Place a descriptor for each chosen^ex in the col- 
umn head of Example Document 10-4. Some 
descriptors (column&,4-10) are presented as ex- 

•amples 

2 Duplicate and distribute Example Document 10-4 or 
your new instrument to instructors 

3 Ask instructors to fill in course title, section number and 
instrugtor's name in columns 1, 2 and 3 respectively 

4 Ask instructors to average, for each sectipn.^the 
measures of student performance you have chosen 
and place these averages in columns 4 through 13 

5. Calculate course averages for each outcome index and 
ent^r it in each column witlj the row corresponding to 
the course title in column 1 



Task H. ' Relate Cost Information to Outcome 

Information ancTPrepare a Written Report. 

It is seldom possible to relate costs to outcomes in ^ strict 
mathematical sense, resulting in some type of cost-benefit ' 
ratio. Instead, since most benefits or outcomes will be 
nonmonetary, the ahalysis can only relate, discuss, and in- 
clude judgements about the apparent relationship 

^ • 

1 Develop or adapt a cost/outcome comparison form 
(See Example Document 10-5.) 

2 > List the course number and course title in columns 1 

and ^ofiExample Document 10-5, respectively. 

3 Enter cost per credit hour from column 15 of Example 
> Document 10-2 in column 3 of Example Document 5 

4. Summarize the most important outcomes from Example ^ 
Document 4 and enter them in column' 4 of Example 
Document 10-5 



erIcio. 



5. Formulate-concluslons about the cost/outcome relatlor\- 
shipS and enter them in Example Document 10-6. Con- 
clusions ar^ judgements about the relationship with 
regard to your original key questions. They can bfe 
either positive or negative. 
An example cohclusiQn is: . • 

Course cost comparisons showed that the simulation ^ 
Health C^re Aide section is more expensive than the 
traditional section. However, comparisons of ^ * 
graduates of the Health Carje Aide course taught via 
simulation and traditional methods indicated that 
13% more graduates of tha simulation group were 
promoted within 5 years • . 
6* For ^ach conclusion that identifies a relationship other 
than optimum, formulate a recommendation alld enter 
It in column 1wo o( Example Document 10-6 
An example recommendation which gives general 
direction for improvement is* 

Based on high outcome data, simulation should be 
^ continued as a method of instruction in the Health 
Care Aide Course 
7 For each recommendation, formulate several suggested 
solutions and enter them in coluirnn 3 of Exapnple Oocu- ^ 
ment 10-6 Suggested solutions are statemerlts of ac- 
^ tion that might be taken to implement the recommenda- 
tions and overcome the deficiency identified in the con- 
clusion It 

Two example suggested solutions are 

Additional simulation activities should be considered 

in the Health Occupations area 

Simulation activities should be considered for other 

occupational curricula. 
8. Once th^ team has prepared this portion of the-report. 
Example Documents 10-5 and 10-6 should be placed in 
a report jhat 'is prefaced with. 
a A degcription of the purpose for the study 
b/A list of key questions 
c A description of the procedures used, and 
d. A list of individuals involved in the evaluation 



Task I Utilize Results of the Cost/Outcome Analysis. 

1 Duplicate and distribute the report to all" staff involved 
in the course ^nd sections focused on the activity Cau- 
tion should be taken to ensure proper interpretation of 
the report. The data from Example Document l'0-5 
should not be considered alone They must be viewed 
\r\ light of conclusions and qualifying statements 

2 Ask the staff to review the findings (information from 
Example Document 10-5) and the narrative conclusions, - 
j'ecommendations and suggested solutions. 

3 Ask for reaqtioTis to conclusions and encourage staff, 
eAher individually, or collectively, to suggest additional 
SQlufions. The more suggested solutions, the better 

4 The report should be used" to answer the key questions 

• posed in Task B and decisions and action should be in- 
itiated Primary uses of the cost/outcome report are 

a. To aid in choosing^ among alternatives 
b To aid in-Improving the efficiency of offerings, and 
c. To provide accountability indices. 
5. Conduct meetings wjth staff members'involved with 
conducting this activity. This^group should plan and 

• monitor activities, directed toward program improvement 



Example Documents 



No. ' 

10-1. InstnjctorGost Data Instrument 

10-2, Cost Data Summary Form (For Team Use) 

I0-3.^0utcome S<Jljrce and Index Specification Form 

10-4. Outcome Data Summary Form 

10-5. Cost/Outcome Companion Fcjrm 

1 0-6. Cost/Outcome Summa ry Report 



Page Number 
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16 
17 
18 
19 
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INSTRUCTOR COST DATA INSTRUMENT 



COURSE 
NUMBER 



c 
E 

I 

(D 

cL 
E 

i2 



GENERAL COURSE INFORMATION 



COURSE TITLE 



\ 



er|c 



12. 



SECTION 
NUMBER 



NUMBER 

OF 
CREDITS 



'NUMBER 
OF 

STUDENTS 



COST INFORMATION 



EQUIP- 
MENT 



SUPPLIES 



BOOKS 



MEDIA 



10 



TRAVEL 




11 



13 



12 



\ 



COST DATA SUMMARY FORM (FOR TEAM USE) 

i 



> 1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


n 


12 


13 


14 


15 


COURSE TITLE 


SECTION 
fiunoLK 


INSTRUC- 
TOR 
NAME 


TOTAL 


PRORATED 

^AI ARY 


EQUIP- 

MFNT 
nun 1 


SUPPLIES 


MEDIA 


TRAVEL 


SECTION 
TOTAL 
COST 


foURSE 
TOTAL 
COST 


NUHBER 
OF 
STUDENTS 


COURSE 
CREDIT 


CREDIT 
HOURS 


COST 
PER 
CREDIT 
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